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ABSTRACT 

Aimed at federal. State, and local educational 
administrators; educational researchers familiar with cost- benefit 
analysis and econometrics; and economists interested in problems of 
educational finance, this study explores the applicability of an 
econometric model of evaluation to the efficiency of schools. The 
emphasis is on assessing school input-output relations that appear to 
be maximizing educational outcomes. The standard constrained— maximum 
model is formulated for the schools where output is reflected by a 
verbal achievement measure; inputs are composed of student 
characteristics, personnel attributes, facilities, and organizational 
variables. The model is applied to a sample of white 6th graders 
attending schools in a large, eastern city during 1965-66. Howeve- 
the model also carries strong implications for those deal' ie 

problems of inner-city and low- income area schools. One oi 
implications of the findings is that evaluation results for any group 
of schools may not be generalizable to any particular school in the 
sample. The possibility of constructing efficiency rankings for 
schools to find out which ones are obtaining the largest outputs for 
their resource is also explored. (Author) 
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Introductory Statement 



The Center is concerned with the shortcomings of teaching in 
American schools : the ineffectiveness of many American teachers in 
promoting achievement of higher cognitive objectives, in engaging their 
students in the tasks of school learning, and, especially, in serving 
the needs of students from low-income areas. Of equal concern is the 
inadequacy of American schools as environments fostering the teachers' 
own motivations, skills, and professionalism. 

The Center employs the resources of the behavioral sciences — 
theoretical and methodological — in seeking and applying knowledge 
basic to the achievement of its objectives. Analysis of the Center's 
problem area has resulted in three programs: Heuristic Teaching, 

Teaching Students from Low-Income Areas, and the Environment for 
Teaching. Drawing primarily upon psychology and sociology, and also 
upon economics, political science, and anthropology, the Center has 
formulated integrated programs of research, development, demonstration, 
and dissemination in these three areas. In the Heuristic leaching pro- 
gram, the strategy is to develop a model teacher training system 
integrating components that dependably enhance teaching skill. in the 
program on Teaching Students from Low-Income Areas, the strategy is to 
develop materials and procedures for engaging and motivating such 
students and their teachers. In the program on Environment for 
Teaching, the strategy is to develop patterns of school organization 
and teacher evaluation that will help teachers function more pro- 
fessionally, at higher levels of morale and commitment. 

The aim of one component of the program on Teaching Students from 
Low-Income Areas is to build an econometric model of school effectiveness. 
This paper attempts to show how a particular econometric approach can be 
applied to evaluating the effectiveness of schools in achieving educa- 
tional outcomes. The findings are particularly relevant for examining 
these relationships for the urban disadvantaged child, since the data 
are drawn from schools in a large city. 
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Abstract 



The purpose of this paper is to explore the applicability of an 
econometric model of evaluation to the efficiency of schools. Emphasis 
is placed on assessing the input-output relations for schools that 
appear to be maximizing educational outcomes. The standard constrained- 
maximum model is formulated for the schools where output is reflected 
by a verbal achievement measure and inputs are composed of student 
characteristics, personnel attributes, facilities, and organizational 
variables . 

The model is applied to a sample of white sixth graders who were 
attending schools in a large Eastern city in 1965-66. Separate esti- 
mates are made for schools that are on the efficiency frontier those 
that are maximizing output — and all schools in that sample. Differ-^ 
ences in estimates of the structural relationships between inputs an< 
outputs are noted and their policy implications are assessed. One of 
the major implications of these findings is that evaluation results for 
any group of schools may not be generalizable to any particular school 

in the sample. 

The possibility of constructing efficiency rankings for schools 
to find out which ones are obtaining the largest outputs for their . 
resource inputs is also explored. It is noted that findings in this 
area are preliminary and subject to further refinement and replication. 
Accordingly, the attempt of this study is to further hone the tools 
of educational evaluation. 



FRONTIER FUNCTIONS: AN ECONOMETRIC APPROACH TO 

THE EVALUATION OF EDUCATIONAL EFFECTIVENESS 



Henry M. Levin 
Stanford University 



Introduction 



The conceptual model for evaluating a productive activity is well 
established in economics. The maximization of outcome for a given cost or, 
conversely, the minimization of costs for a given outcome leads to a specific 
criterion for determining which combination of inputs (or treai_ments) to 
employ. More formally, we can define the following production function 
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( 1 ). 

(1) Y (*!, X 2) V 

(1) represents the most general function that describes a productive 
activity where Y represents the output arid (X- . . . X ) represents the 

inp s. Since the production function describes the maximum output that 
can be produced with each and every combination of inputs, we are concerned 
only with the surface or this polyhedron. Of course, this is a static con 
cept based on the state of technology available at the time. 



This paper was prepared for the 1971 Meetings of the Psychometric 
Society April 8, 1971, at St. Louis. The author wishes to express appre- 
ciation to Richard Carlson, Guilbert Hentschke, and Helen Loceff for their 

assistance . 

‘'"For an introduction to production and costs, see William J. Baumol , 
Economic Theory and Operations Analysis , 2d ed. (Englewood Cliffs, N. J.: 
Prentice-Hall, 1963), ch. 11. More advanced expositions are found in 
W. E. G. Salter, Productivity and Technical Change (Cambridge, Eng.. 
Cambridge University Press, 1960); Sune Carlson, A Study o n _ the Pure 
Theory of Pro duction (New York: Kelley and Millman, 1956); an. arc 

Nerlove , Estimation and Identification of Cobb - Douglas Production Functio ns 

(Chicago: Rand McNally, 1965). 



If there is a maximum value for each set of inputs, the function 
is single-valued; and we assume that it is smooth and continuous, vitn 
partial derivatives at every point. Further, we assume test the partiai 
derivatives or marginal physical products of the inputs are non-negative 
(2) 3Y/9X. =/’. ^ 0 

since if they were negative, output would not be maximal. Thus, output 
can be increased by not using inputs with negative marginal products. 

A second general assumption is that the second partial derivatives 



are negative. That is: 

(3) f ± . = 3 2 */ 3X.. < 0 

(3) represents the convexity properties of the production function and 
corresponds to the well-known law of diminishing returns. The contribution 
of any input to output will be a diminishing one, the higher the level 

of Utilization of that input. 

Yet an infinite number of combinations of inputs will obtain a 
given output. Out of these possibilities, how does one obtain a unique 
set? It is only when a budget or cost constraint is imposed that a deter- 
minate solution to that problem can be obtained. Assume that the pro- 
ductive enterprise is faced with a budget, B, a fixed amount of dollars; 
and that this budget must be allocated among the n inputs into the pro- 
duction function. Clearly, the amount of any input that can be purchased 
depends or its price; and the obtainable combinations of all inputs depend 
on their prices. This can be expressed more formally by (4). 

(4) B = P 1 X 1 + ? 2 X 2 + • • • + p n x n + i=l P i X i 

• ,n't-h a nr ice P and we assume that the inputs 

Each input X ± is associated with a price ^ 



markets so that the prices are invariant with 



are obtained in competitive 
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regard to the amount of each input selected. (4) 

constraint within which the producer must operate 

In order to maximize output (Y) , subject to 

2 

we define a new function (5) . 

(5) W = (X n X„ ... X) + X (B - P X q - 

1, 2, , n 11 



represents the budget 



budget constraint (B) , 



P 2 X 2 " 



- P X ) 
n n 



Since this is a constrained maximum, we use the method of the Lagrangean 
multiplier (A) . \ ^ 0 . The necessary conditions for a maximum require 
our setting the first derivatives equal to zero, as in (6). 

9W/9X 1 = 0 = f 1 ~ X? 1 

9W/9X = 0 = f 0 - AP ? 

( 6 ) ' 

9W/9X = o = r - AP 

n / n n 

9W/9A = 0 = B - P.^- P 2 x 2 ~ “ p n x n 

Solving the first set of equations for A we obtain 

(7) X -/ i/P L = /2/P 2 = ... = /n/P n 

(7) suggests that in order to maximize output for any given budget, the 
marginal product of the last dollar spent must be the same for all inputs . 
Stated another way, the ratios of marginal products to prices must be 
equal for all inputs. Second— order conditions for a maximum require that 
the bordered Hessian determinant in (8) be positive: 

^Readers not familiar with the formulation and solution of constrained 
maxima (minima) problems may wish to see Paul A. Samuelson, Foundations of 
Economic Analysis (Cambridge , Mass . : Harvard University Press, 1947), 

ch . 3 and 4 . 




( 3 ) 
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If all our assumptions hold, then we need only satisfy the conditions in 
(7) to maximize the outcome that we seek for a given budget constraint. 
That is, we should allocate our budget among inputs or programs in such 
a way that the marginal contributions of all inputs or programs, relative 



to their prices, are equal. 

How can this approach be applied to educational evaluation? The 
educational sector represents a set of productive activities that can be 
conceived of in the light ° f the production concepts introduced above. In- 
puts of students, personnel, facilities, and so on are used to produce an 

O 

outcome called education. Consider a general production function for 

4 

education as it applies to each student. 



^ An excellent review of educational production functions is Samuel 
S. Bowles, "Towards an Educational Production Function,” in W. Lee Hansen, 
ed . , Education, Income , and Human Capital , Studies in Income and Wealth, 
vol. 35 (New York: National Bureau of Economic Research, 1970) , pp* 11- 
61. A nontechnical summary of results is found in James W. Guthrie, 

George B, Kleinaorfer, Henry M. Levin, and Robert T. Stout, Schools and 
Inequality (Cambridge, Mass.: MIT Press, 1971), ch. 4. Analyses of more 

recent technical developments are found in Alexander M. Mood et al. , 
Teachers Make a Difference?, A Report on Recent Research on Pupil Achieve 
ment, OE-58042, U. S. Department of Health, Education, and Welfare 
(Washington, D. C. : Government Printing Office, 1970); see particularly 

the papers by Henry M. Levin, "A New Model of School Effectiveness" 

(ch. 3), and Stephan Michelson, "The Association of Teacher Resourceful- 
ness with Children's Characteristics" (ch. 6). 

4 See Levin, "A New Model of School Effectiveness." The general 
approach and empirical work that follow are based on a model and a data 
set described in that paper. If the reader has questions on either of 
these, he may find it useful to refer to this earlier work. 
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(9) 



The 



(t) 



A it 8 [F i (t) 



i subscript refers 



refers to an input 



S. - N P. , N 0. , N I. ] 

, l (t), i (t) , i (t) , it 
to the ith student; the t subscript 
that is cumulative to time t. 



in parentheses 



A = a vector of educational outcomes for the ith student at 

it . . . 

time t 

■p 

i (t) = a vector of individual and family background character- 
istics cumulative to time t 

s 

i (t) = a vector of school inputs relevant to the ith student 
cumulative to t 

i (t) = a vector of peer or fellow student characteristics 
cumulative to t 



i (t) = a vector of other external influences (the community, for 
example) relevant to the ith student cumulative to t 



I . 

l 



t 



a vector of initial or innate endowments of the ith student 
at t 



Although only a few studies specify the general form of the educa- 
tional production function as in (9) , most explorations seem to be based 
on such a model. In any event, there are many examples in the literature 

of such estimates, and there have also been several attempts to develop 

• 6 v 

the methodology for estimating educational production functions. iet 
very little theoretical or empirical work has been done on a very im- 

”*See Eric Hanushek, "The Production of Education, Teacher Quality, 
and Efficiency," i n Do Teachers Make a Difference ?, ch. 4. 

6 See , for example, the works by Bowles, Levin, and Michelson cited in 
note 3. 
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portant aspect of educational production functions, that of seeking 
estimates of the max imum output that can be produced with a given set 
of inputs. 

Average versus Frontier Estimates 

The problem can be stated in the following way. Suppose we obtain 
survey data for a sample of children among a set of schools (e.g., sixth 
graders) . For each child we observe measures of educational outcome at 
time t as well as proper measures for the elements of the family, school, 
peer, other influence, and innate endowment vectors. Assuming no errors 
in the variables (measurement errors) or in the equations (specification 
errors), we could estimate a structural relation between A ± t and the 
input vectors, and the estimated coefficients would represent the marginal 
products of each input with regard to A. t . But, in order for the re- 
lationship described by these points to depict a production function, 
all points must be based on each school being 100 percent efficient, pro 
ducing as much A as can be attained from its inputs. 

There is no reason to believe that schools are fully efficient 
in this sense. Indeed, schools are not likely to be educational output 
maximizers so long as there are few incentives for schools to maximize 
educational outcomes (such as verbal scores), managers exercise insuffi- 
cient discretion over inputs, systematic information is not available to 
educational managers on inputs and outputs, and traditional ways of opera- 
ting are revered. If this is so, then the statistical relationships 
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ascribed above depict production relations among schools at varying 
agrees of efficiency rather than among schools at the frontier. 




= constant (average) 



= constant (frontier) 



Fig. 1. Frontier and average production isoquants. 



7 This was not recognized explicitly even for private sector 
mates of production functions until quite recently. See Michael 
"The Measurement of Productive Efficiency," Journa l of the Roya 
Society , Series A (General), vol. 120, part 3 (1957), pp. 253-81 



esti- 
Farrell , 
Statistical 
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The situation is shown in Figure 1, which represents a hypo- 
thetical input-input space where S and represent two different 
school inputs into the production of A. (It is assumed here that other 
inputs are being held constant; of course, this example can be general- 
ized algebraically for n inputs.) Each observation represents the com- 
bination of and that a particular school is using to produce a given 
amount of output, Ao . That is, each school in the sample is using a 
different input mix even though ou '^ut the same. 

Isoquant Ao^ represents the p. ucf .on frontier defined as the 
locus of all c nervations that minimize the combinations of S. and S 9 
required to produce constant product Ac „ It represents a mapping of the 
most efficient points for producing Ao and is thus the production frontier. 
All observations to the northeast of Ao^ are of inefficient schools that 
are using higher input levels to produce the same output. Now assume that 
we fit the observations statistically via normal regression procedures. 

We obtain the statistical equivalent of Ao^ for all schools (both efficient 
and inefficient ones) . Of course all points on Ao ^ are farther from the 
origin than those on Ao^, showing that the average production relationship 
is a less efficient one than the frontier relationship. 

Since virtually all estimates of educational productions have been 
based on the performance of both average and efficient schools rather 
than efficient ones only, the existing statistical studies of educational 
production are not production function studies in the frontier sense. 
Moreover, their results may suggest erroneous conclusions about which com- 
bination of inputs (program) maximizes outcomes for a given budget con- 
straint. For example, assume the two-input production function: 
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(10) A = h(s^ , s 2 ) 

In equilibrium we would wish to satisfy the conditions set out in (11) , 
where P^ and P 2 represent the prices of and respect ively . 

(11) 9Y/9 S;l _ 9Y/9s 2 or h 1 _ h 2 




Now consider two different values for h^ and h 2 » i. ' th fror ier , 
h^ h 1 , and for the average of all schools, h^ = h " a s; jols lor h 2 
can be defined in the same way. Rearranging the terms (7) nd applying 
it to the case at hand we obtain (12) . 

(12) h 1 h° P ] _ 




(12) reiterates the necessary conditions for a maximum both for frontier 
estimates and for average estimates of the production function. In both 
cases we wish to select the combination of inputs that equates the ratios 
of marginal products (first derivatives) to the ratios of prices. 

Implications for Evaluation 

If we estimate only the average production function or only the 
frontier one, can the optimal ratio of inputs derived from one estimate 
also apply to the other? The answer to this question clearly depends on 
whether there are differences in the structural parameters associated with 
each input . 

For example, it is possible that the inefficiencies of non-frontier 
schools are neutral among inputs so that at every level of input and for 
every combination of inputs the ratios of the marginal products are 
identical for both frontier an: average functions. 7 lat is, (13) holds. 
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(13) h. = Y h. (i = 1,2) 

i i 

o < Y ^ 1 

This can be represented by Figure 2, where Ao^ signifies the production 
isoquant for Ao for all efficient schools and Ao 2 represents th - ,ie 




Fig. 2. Technical inefficiency that is neutral among inputs. 

level of outnut for the entire set of schools, efficient and inefficient. 
B and represent budget or isocost lines reflecting the various 

combinations of S and S 2 obtainable for two given cost constraints, B 
and C, where C > B. The slope of the isocost lines is determined by the 
ratio of the prices, P 2 /P 1 . Thus, E and F represent equilibrium points 
which reflect (12). That is, the combination of S.^ and S 2 that maximizes 
Ao for budget constraint B is determined by the tangency of A q1 to B 2 
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at point E for efficient or frontier schools and of A „ to C, C at 

oZ J. z 

point F for schools on the average. 

It can be shown that the relative intensities of the two inputs 
will be identical for both groups of schools if a ray drawn from the 
origin intersects both points ot tangency. 0 M satisfies that condition, 
so the same ratio of S^/ is optimal for both groups of schools. Whether 
we use the estimates of frontier schools or of all schools, the findings 
on the optimal combinations of and will be binding for both. in 
such a case it does not matter which group we use to estimate the pro- 
duction function, although the absolute product will be higher for the 
set of schools at the frontier for any input level. 

On the other hand, there is a case where (13) does not hold. This 
can be shown in Figure 3, and it is also evident in Figure 1. Here the 




Fig. 3. Technical inefficiency that is biased between inputs . 
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relative inef rency in the use u appears to be greater than that 
for S^. For example, if represents physical school facilities and 
represents te? ers , Figure 3 suggests that the organizational arrange- 
ments in inefficient schools are relatively more harmful to the pro- 
ductivity of the teachers than to that of the facilities. _n this case 
a ray drawn through the origin representing a constant ratio of inputs 
will not intersect both points of tangency. That is, the optimal ratio 
of ^° r f ront: *- er schools will be different from that for ineffic. ;nt 

schools. In this case,- the results obtained for one group of schools 
(e . g . , frontier ones) cannot be applied to another group (e.g., non- 
frontier ones.). Rather, each set of schools will have their own optimal 
combination of depending on their relative efficiency. 

An Empirical Application 

One major difficulty in demonstrating some of the empirical im- 
plications of the foregoing analysis is that the necessary relationships 
are much easier to obtain mathematically than they are statistically. 

The particular problems in deriving educational production runctions have 
been described elsewhere, so they will not be detailed here. It is use- 
ful to note, however, that the statistical work in this area is subject to 
both errors in the equations and errors in the variables. In the former 
case the proper specification of the model is still in the exploratory 
stage. The structure of the model, the specific variables to be in- 
cluded, and the relationship of the variables to one another have not 
been well established, and there are many gaps in our knowledge. Moreover 
most of the operational variables used in the models are subject to 
varying degrees of measurement error. 
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Thus no strict application of the findings to public policy is 
warranted. Rather, the empirical aspects are meant to suggest new 
directions and to provoke new thought on the process of evaluation. 

The results derived must surely be subject to replication and further 
analysis before they can be considered acceptable for policy considera- 
tion . 

Th e Sample 

The data used in this analysis represent a subsample drawn from 

the Survey on Equal Educational Opportunity conducted by the U. S. Office 

of Education for the school year 1965-66. Specifically, the subsample 

is composed of some 597 white sixth graders who had attended only the 

8 c- 

schools in which they were enrolled at the time of the survey. Since 
the data were reanalyzed and recoded extensively for the purpose of 
estimating present relationships, they differ in important ways from 
the data used in other studies that have drawn information from the same 
survey. Twenty-nine schools are represented in the sample, and the 
teacher characteristics identified are averages for each school for all 
teachers who were assigned to grades three through five. These aver- 
ages were intended to reflect the teacher characteristics that had 
influenced student behavior up to the time of the survey. Moreover, it 
was assumed that the observed measures of family background and other 
educational influences were related systematically to the cumulative 
impact of each of these variables. 

"see Levin, "A New Model of School Effectiveness," 




for details. 



The equation used to explore differences between frontier and 
average estimates is a linear equation based on (9) . Lin e arity nC>t 
only violates our assumptions about the second derivative > but it 
runs counter to our intuition about the real world. Nevertheless >, 
difficulties of estimating particular nonlinear functions and the tHb 
of creating even greater specification biases in the coef f icieb-ts p7 
imposing another arbitrary functional form suggest that th e li^eab 
equation might yield reasonable first approximations to th e 
that we seek. Following this procedure, of course, limits our 
son of the frontier and average estimates to the linear U\a r gtn a l 
products and price ratios. 

The variables in the equation are shown in Table 1* These 
ables are taken from the reduced-form equation for verbal achiev a tt/\ 
derived from a four equation system encompassing three Simultaneous 
equations and one that represents a recursive relationship. tfhce Apt 
system is estimated, one can solve for the reduced~form equation f^ 
any of the three endogenous variables. Since the estimation t>f th^ 
system is discussed elsewhere 9 , this paper is concerned ohly tfXth As 
reduced form of the verbal equation. Since this equation wag f ift^ 
the entire sample of observations, it represents the average ptodpAi Q b 
relationship for the sample of schools. Results are shQyn f Q { thA 
estimate in the right-hand column of Table 2 (p. 19) • 

9 Ibid. 



TABLE 1. List of Variables 



Variable 



Item Measured 



Coding 



Verbal Score Student Performance 



Raw Score 



Efficacy Index compiled from questions 

33-40 in the Sixth-Grade Student 
Questionnaire of the Equal 
Opportunity Survey 
"I can do many things well." 

(Well/No/Not Sure) 

"I sometimes feel I just can't 
learn . " 

(Yes/No) 

The higher the value of the index 
the greater the perceived efficac 
of the student. 



Sex 



Age 



Educational Expecta- 
tions of Parents 



Student Motivation 



Index based on three questions : 

(1) How good a student does your 
mother want you to be? 

(2) How good a student does your 
father want you to be? 

(3) Did anyone at home read to 
you when you were £>mall, 
before you started school? 
(and how often?) 

Grade level the student wishes 

to complete 



Male-Female 

Differences 

Overage for Grade 



Male = 0 
Female = 1 

Age 12 or over = 1 
Less than 12 = 0 



Possessions in Family Background 

Student's Home (Socioeconomic Status) 



Index of 



Yes = 1 
No = 0 
for each 
item . 
Index 
is sum. 



possessions : 
television 
telephone 
dictionary 
encyclopedi a 
automobile 
daily newspaper 
record player 
refrigerator 
vacuur cleaner 



(Table 1 cont'd. p-16) 
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Variable 


Item Measured 


Coding 


Family Size 


Family Background 


Number of people in home 


Identity of 
Person serving 
as Mother 


Family Background 


Real mother at home = 0 
Real mother not living at 
home = 1 

Surrogate mother = 2 


Identity of 
Person Serving 
as Father 


Family Background 


Real father at home = 0 
Real father not living at 
home = 1 

Surrogate father = 2 


Father ' s 
Education 


Family Background 


Number of years of school 
attained 


Mother ' s 

Employment 

Status 


Family Background 


Has job = 1 
No job = 0 


Attended 

Kindergarten 


Family Background 


Yes = 1 
No = 0 


Teacher ' s 
Verbal Score 


Teacher Quality 


Raw score on vocabulary test 


Teacher ' s 

Parents' 

Income 


Teacher Socioeconomic 
Status 


Father's occupation scaled 
according to income (1000 's 
of dollars) 


Teacher 

Experience 


Teacher Quality 


Number of years of full-time 
experience 


Teacher ' s 

Undergraduate 

Institution 


Teacher Quality 


University or college = 3 
Teacher institution = 1 


Satisfaction 
with Present 
School 


Teacher's Attitude 


Satisfied = 3 

Maybe prefers another school = 2 
Prefers another school = 1 


Percent of 
White Students 


Student Body 


Percentage estimated by teachers 


Teacher 

Turnover 


School 


Proportion of teachers who left 
in previous years for reasons 
other than death or illness 


Library Volumes 
Per Student 


School Facilities 


Number of volumes divided by 
school enrollment 
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Obtaining Frontier Estimates 

The same set of data and variables can be used to obtain esti- 
mates of the equation for only the most efficient observations. There 
are several ways of doing this; the one used here is the programming 
approach in input-output space suggested by Aigner and Chu. 10 Since 
the individual observations are of students rather than schools, we 
wish to seek those students who show a particular outcome with the 
lowest application of resources. Using the general notation from (1) , 
the problem is to minimize (14) . 



(14) 



n 

£ 

i=0 



a .X. 
i i 



where a is the parameter for the ith input, X is the mean of 
i x 

X and X =1 in order to obtain a constant term. More specifically , 
i* o 

the problem is to minimize (14), which can be rewritten as (15) subject 
to the constraints (16) . 



(15) 



Min. 



“ 0 + a 1 X 1 + • • • + a n X n 



Subject to: 



(16) 



a Q + a 1 X 11 



+ ...+ ot X - ^ Y- 
n nl 1 



a o + a l X im 



+ . . . + ot X Y 
n nm m 



a, > 0 



10 . 



D. J. Aigner and S. F. Chu, "On Estimating the Industry Production 



Function," A merican Economic Review , 58 (1968): 826 39 
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Since this is essentially a linear programming problem, there will 
be as many "efficient" observations as there are inputs into the pro- 
duction function (assuming that no two observations are identical) . Un- 
fortunately, some of the observations will appear to be "efficient" 
when in fact they represent measurement errors. Thus, it is impossible 
to know a priori whether a particular observation is efficient, or 

whether it is spurious. Following Timmer extreme observations have been 

11 

discarded in order to eliminate what might, be spurious points. This 

is particularly important for the frontier estimates, since very few 



observations determine the structural coefficients. 

Table 2 contrasts the frontier estimates with the estimates for the 



average function. Figures in parentheses beneath each coefficient for 
the average function signify the t statistics of those coefficients. 

Each of the coefficients represents the first derivative or marginal 
product of the function. 12 Four linear programming runs were used to 
obtain frontier estimates. Run 1 eliminated no observations; Run 2 dis- 
carded the nine most "efficient" points; Run 3 eliminated 23 observations; 
and Run 4 discarded the 38 most extreme points (about 6 percent of the 
sample) . I will compare the frontier function from Run 4 and the average 



1;L C. Peter Timmer, "On Measuring Technical Efficiency." Unpublished 
dissertation, Department of Economics, Harvard University, 1969. 



Ph.D. 

^Since 0, those variables that showed negative coefficients for 

the average function represented problems for the programming estimates.. 
The array for each such variable was multiplied by (-1) for the programming 
estimates, and the signs were reversed in turn when reporting the resu s 
in Table 2. The author is indebted to Richard C. Carlson for . computing 
the programming estimates. See his paper, "Educational Efficiency an 
Effectiveness." Unpublished paper prepared for Seminar in Economics of 
Education. Stanford University, May 1970. 
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TABLE 2. Frontier and Average Production Relations for 
White Sixth Graders, Eastmet City 



19 



■ — 






Function 




Average 






Frontier 




Function 


Variable 


Run 1 


Run 2 (-9) 


Run 3 (- 


•23) Run 4 (-38) 




Personal Variables 








0.01956 


0.817 


Sex 


0.0 


1.649 


0.982 










(1.41) 


Age 


7.714 


-4.642 


-4.769 


-5.553 


-6.010 

(-4.49) 


Family Size 


0.502 


-0.500 


-0.089 


-0.770 


-0.552 

(-3.50) 


Father ' s 
Identity 


0.0 


0.0 


-0.283 


-0.420 


-0.327 

(0.64) 


Mother's 

Identity 


-0.878 


-1.342 


-1.190 


-1.202 


-0.433 

(-1.90) 


Father ' s 
Education 


0.509 


0.179 


0.0 


0.103 


0 ’ 27 ^3 . 22) 


Mother's 

Employment 


-1.726 


-2.293 


-1.089 


-0.951 


-0.509 

(-1.31) 


Possessions 


1.865 


1.464 


1.070 


1.020 


1.229 

(5.201) 


School Variables 








2.106 


2.372 

(2.47) 


Kindergarten 


0.0 


2.866 


1.920 


Teacher ' s 
Verbal Ability 


0.810 


0.218 


0.695 


0.791 


0.250 

(1.70) 


Teacher's 
Parents' Income 


0.0 


0.0 


0.0 


-0.00006 


- 0 ’ 11 ?- 0.64) 


Undergraduate 

Institution 


3.736 


5.269 


1.991 


8.307 


6.525 

(2.09) 


Teacher 

Experience 


0.0 


0.392 


0.368 


0.616 


0.787 

(4.93) 


Teacher 

Satisfaction 


3.630 


7.078 


4.666 


3.608 


1.960 

(1.50) 


% White 


0.0 


-0.500 


-0 . 264 


-0.178 


-0.047 

(-.03) 


Students 










Library Vols. 
Per Student 


0.0 


0.571 


0.509 


0.156 


0 . 565 

(1.53) 


Teacher 

Turnover 


0.0 


0.0 


0.0 


-0.035 


-0.101 

(-1.27) 


Constant 


0.0 


0.0 


-0.944 


--4. 051 


-7.902 

(.84) 
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function and at the same time will examine three properties of the esti 
mates: (1) the relative magnitudes of the coefficients; (2) the implica- 

tions for allocative or price efficiency; and (3) an overall technical 
efficiency index. 

Recall that in order for findings of optimal input intensities to 
yield the same relative applications of inputs for both average and 
frontier schools, the marginal products for both functions must bear a 
constant relation to each other as reflected in (13). Table 3 shows the 
ratios of marginal products for the two sets of estimates for all of the 



TABLE 3. Ratio of Marginal Products at the "Frontier 
to Marginal Products for the Entire Sample 



School Variables 


MP (frontier) 
MP (average) 


School Variables 


MP 

MP 


(frontier) 

(average) 


Kindergarten 


.888 


Teacher 


Satisfaction 




1.841 


Teacher’s Verbal Ability 


3.164 


Percent 


of White Students 3.787 


Teacher’s Parents’ Income 


.001 (.0005) 


Library 


Volumes per 


Student .276 


Undergraduate Institution 


1.273 


Teacher 


Turnover 




.347 


Teacher Experience 


.783 


Constant 




.513 



school variables. According to this table there is no systematic relation- 
ship between the two sets. At the frontier, such inputs as the teacher's 
verbal facility and the proportion of white students to others show marginal 
products that are more than three times their counterparts derived for the 
sample as a whole. On the other hand, such variables as teacher turnover, 
teacher experience, and library volumes per student show much smaller co- 
efficients for the frontier function. 
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If these estimates are truly unbiased, the implication is that so- 
called frontier schools are more efficient in the use of some inputs and 
less efficient in the use of others. Standard errors of the coefficients 
tend to be high relative to the differences in coefficients. Even so, 
the coefficient for teacher’s verbal ability is significantly different 
between the two estimates, and other differences are on the margin of 
significance. This in turn suggests that the production isoquants for 
schools of different "efficiencies" may be intersecting within the rele- 
vant ranges of factor input substitution. Thus any optimal comber tion of 
inputs for any set of schools or any individual schoc_ -= likely to be 
less than optimal for any other set of schools of individual school. In 

other words, for any given array of prices (P^ ^ 2 , ^n^ 

set of input proportions may vary significantly from s hool to school. 

For purposes of generalizing, this is the worst (- all possible 
worlds. That is, whereas we might be able to derive the optimal input 
structure for frontier schools or for schools on the average as repre- 
sented by equilibrium conditions stated in (12) , it is likely that the 
desirable combination of input intensities may differ between the two sets 
of schools (and may even differ significantly from school to school) . 

An illustration of this is found in Table 4, which shows the esti- 
mated ratios of prices for two inputs (teacher verbal score and teacher 
experience) as well as the two sets of marginal products for those in- 
puts. The "prices" reflect the increments to annual teacher salaries for 
each of the teacher attributes; they were derived from an equation re- 



TABLE 4. Relative Prices and Marginal Products for Teacher 
Verbal Score and Teacher Experience 



( 1 ) ( 2 ) 

Teacher Verbal Teacher 

Score Experience 



(3) 

Ratio of 
(1) to (2) 



Price 

(salary 

increment) 

Marginal 
Prod.ict at 
Frontier 

Marginal 
Product on 
Average 



$24.00 



0.791 



0.250 



$79.00 



0.303 



0.616 1.284 

0.787 0.317 



latir.g teacher attributes to earnings in the Eastmet teacher market. 

The marginal products associated with a unit change in the two inputs are 
taken from Table 2. In equilibrium the ratios of the marginal products of 
the inputs should be equal to the ratios of their respective prices. For 
the average production estimates these ratios are almost identical, so 
that allocative or price efficiency is implied even though the average 
estimates are assumed to be based on technically inefficient (non frontier) 

schools . 

On the other hand, the frontier estimates show a ratio of marginal 
products four times as great as the price ratio for the two inputs. Thxs 
suggests that the utilization of more verbally able teachers yields four 
times as much output per dollar as the utilization of additional teacher 



13 r 



3 These are taken from Henry M. Levin, "Recruiting Teachers for Large 
Citv Schools," mimeographed. The Brookings Institution, . ^ 

similar application of these prices, see Henry M. Levin, "A Cost-Ef f ectxve- 
ness Analysis of Teacher Selection," Journal of Hu man Resources, 5, No. 
(1970): 24-33. 
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experience. If this is correct, the schools on the frontier could 

increase total output by reallocating their budgets in favor of teachers’ 

14 

verbal scores rather than their experience. 

The significant aspect of this analysis is that the combination of 
inputs which maximizes output differs between the two estimates. If -hese 
differences persist among schools of different efficiencies, tne hope of 
obtaining general decision r les that can be applied across scnools seems 
to be frustrated. That is, the lack of similarities among the production 
techniques used by different schools may mean that neither average nor 
frontier findings can be apr-ied to any particular school. Indeed, m 
the extreme case, each indi- idual school is on its own production 
function, and evaluation results for any group of schools will not be 
applicable to individual schools in the sample. 

Overall Efficiency Ratings 

The foregoing analysis is rather pessimistic with regard to the 
possibility of establishing resource allocation criteria from estimates of 
the educational production relationship, whether the estimates are ob- 
tained from the sample as a whole or at the frontier. But there is 
still one interesting evaluation exercise that might have some validity. 
With a set of production coefficients for efficient schools, it is possible 
to calculate for each school what its output would be if it used its 
resources efficiently. This estimated output could he compared with 
actual output for each school to obtain a rating of efficiency, as in (17). 

1 ^ f For a similar finding see Ibid . 
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actual output^ 

(17) E k = 

maximally efficient output^ 

(17) is a technical - "iciency index where is the technical efficiency 

of the kth school. The index for schools is defined as in (18). 



m 




where j k = individual student j in the kth school (j = 1, . . . , m) . Thus 

the school efficiency rating is an arbitrary index of actual student pe 
formance relative to the predicted maximal level (both averaged over 
students for each school)* 

Using this measure of technical efficiency, the 29 schools in the 
sample showed fairly substantial variance. The mean efficiency for the 
sample was .76, but the index on a school-by-school basis varied between 
1.00 and 0.13. Since these extreme values were realized for schools with 
only one child in the sample 15 , they are not likely to be reliable. 

Using five students as a minimum sample size for establishing a range, 

the efficiency index varies between .46 and .91. 

It is probably in the area of establishing overall efficiency ratings 
among schools that the frontier approach has the most promise. An index 
of that sort would yield an overall statistic on how efficiently a 



15 Bear in mind that the sample selected from each school was ^ited 
to sixth-grade white children who had attended only the school m which 
they were enrolled at the time of the survey. In the cases of some inner 
city schools, only one or two students fulfilled those prerequisites. 
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school is using its resources relative to schools on the frontier. If 
such indicators of efficiency are valid, they might have important 
implications for put _ic co_ icy. Efficient schools could be compared with 
ineffi.-ent ones tc see h.w they differ, and policy recommendations 
for in', coving the latter schools might be forthcoming. Although it is 
tempting to make this application, the grounds for expecting large errors 
in the estimates are substantial. Thus, major refinements in measurement 
and structural specif i ration will be needed before such an efficiency 
rating can be considers- reliable enough tor policy use. 



t 
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